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I propose a "quantum annealing" heuristic for the problem 
of combinatorial search among a frustrated set of states char- 
acterized by a cost function to be minimized. The algorithm 
is probabilistic, with postselection of the measurement result. 
A unique parameter playing the role of an effective tempera- 
ture governs the computational load and the overall quality of 
the optimization. Any level of accuracy can be reached with 
a computational load independent of the dimension N of the 
search set by choosing the effective temperature correspond- 
ingly low. This is much better than classical search heuristics, 
which typically involve computation times growing as powers 
oflog(JV). 
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Quantum computation |1J] has recently attracted a 
widespread interest since it appears more powerful than 
its classical counterpart. On one side, quantum algo- 
rithms can be much faster than classical ones. Such al- 
gorithms can tackle problems in new complexity classes 
which are inaccessible (in polynomial time) to classical 
Turing machines, the paramount examples being Shor's 
factoring algorithm pf and Grover's search algorithm || . 
On the other side, quantum mechanics offers a framework 
for associative memories with exponential storage capac- 

ity g|. 

The original amplitude amplification via Grover's al- 
gorithm J3] and its generalization B are appropriate for 
decision problems with a simple test of whether a state 
satisfies a condition or not, i.e. for searching for "known 
states" . On the other hand, a large class of search prob- 
lems involves such a quantity of constraints that no single 
state satisfies them all, i.e. the system is frustrated [J7). 
In such combinatorial searches one associates with each 
state a cost and the goal is to find the minimum cost 
state: this is the problem of optimization. 

Most such optimization problems are hard, in the sense 
that they seem not to be solvable exactly with a com- 
puting effort bounded by a polynomial of the number 
n of bits necessary to encode an instance. To overcome 
this hurdle, heuristic methods have been developed which 
have computational requirements proportional to small 
powers of n. The price for this speed-up is that these 
methods are not guaranteed to find the true minimum- 
cost state but provide only a near-optimal solution. Some 
of the best known classes of such optimization heuristics 
are simulated annealing || and genetic algorithms || . 

In order to generalize Grover's result to quantum com- 



binatorial searches a quantum optimization algorithm is 
needed. Such an algorithm has been proposed by Diirr 
and Hoyer Q. It has almost sure success in bounded 
time 0(\/N), where N is the dimension of the set to be 
searched. Another approach to quantum optimization 
is, instead, to construct quantum analogues of classical 
heuristic algorithms. In this case one might expect both 
a speed-up of the above exact quantum result due to the 
approximate nature of the procedure and an improve- 
ment upon the behaviour of classical counterparts due to 
the quantum nature of the algorithm. In this paper I will 
show that this is indeed the case. 

A first proposal in this direction was recently made 
in pT[ |, where a deterministic quantum optimization was 
presented. Quantum algorithms are deterministic if only 
unitary operations are performed. On the other hand 
there are also probabilistic algorithms, in which interme- 
diate measurements are performed in addition to unitary 
operations, with postselection of the measurement result. 
These are called probabilistic since the desired result is 
produced only with a certain probability and repetitions 
are thus necessary, a paramount example being proba- 
bilistic cloning [Q. Here I will propose a probabilistic 
quantum optimization algorithm. 

The first step is to encode the elements of the search 
set on states of n qbits (quantum bits). Let's assume 
there are N — O (2") such elements, corresponding each 
to a binary number I k between 1 and 2™. One can then 
use the algorithm of ref. [Of, or its simplified version 
presented in Q , to store a superposition of all instances 
in a single quantum state of n qbits: 
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Next one must identify the cost function and represent 
it as a function C (q±, . . . ,q n ) of the n bits. The imagi- 
nary exponential of this function has then to be realized 
with quantum gates Q as a unitary operator on the state 
\S). In general this poses problems for the feasibility of 
quantum optimization algorithms since it is not guaran- 
teed that exp(iC) can be realized with only simple gates 
involving few qbits. To avoid this problem I will assume 
here that the cost function can be represented by a trun- 
cated expansion 
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of terms involving at most m bits. This is actually not 
a big restriction, since most combinatorial search prob- 
lems admit a representation of this type. As an example 
I mention the random graph partitioning problem of di- 
viding an even number V of vertices pairwise connected 
with probability p by a set E of edges into two sets V\ 
and V2 of equal size, such that the number of edges join- 
ing the two sets is minimal. As shown in [JL4|, the cost 
function given by the number of edges joining V\ and V2 
can be represented as 



C 



V(V - l)p 



2 J ^ Jk 



l<3 




(3) 



where Si = 2qi — 1 = 1 if vertex i £ V± and Si = — 1 
if vertex i £ V2, J%j = J if edge (i,j) £ E and Jj,- = 
otherwise. The last term is a soft implementation of the 
antifcrromagnetic constraint J2i s « = 0- 

I will denote by C m i n and C max strict lower and upper 
bounds for the cost function, 



Cmin < C (qx, . . . , q n ) < C-a 
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The unitary operator necessary for quantum optimiza- 
tion is then 
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For a cost function of the form (Q), this operator can be 
realized on \S) as 



u =n n °t..i». 

fc=l i x =£...=£i k 

where G k are diagonal fc-qbit gates given by 

G k = diag (e^^COx,-..^), . . . >e *f <&„(ii,..,i*)) 

C (<7l, . . . , <7fc) — yC m in 
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and the subscripts denote generically the qbits on which 
operators are applied. For m not too large, the unitary 
operator U is thus feasible, since it can be realized with 
simple quantum gates involving only few qbits. 

Having introduced the two building blocks of quan- 
tum optimization, the search state \S) and the unitary 
operator U, I will proceed to the description of the op- 
timization algorithm proper. This involves, in addition 
to the n qbits in state \S), also a second register with 
b control qbits \c%, . . . , q,), all initially in state |0). The 
initial quantum state is thus given by 
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Applying the Hadamard gate JJJ 
to the first control qbit one obtains 
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At this point I need to introduce the controlled gate 
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which realizes on the search state \S) the unitary trans- 
formation U if the control qbit c is in state |0) and the 
unitary transformation U^ 1 if control qbit c is in state 
|1). This can be realized as 
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(cG k - 2 ) = |o c )(o c | ® i n .., fc + |i c )(i c | ® c fe r 2 . lfc , (12) 

where CG fe is the standard controlled G k gate, real- 
ized only if the control qbit is in state |1) [jj]]. This shows 
that also U ± is feasible, since at most (m+ l)-qbit gates 
are involved. 

Applying [7^ s to |^i) gives 
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Note that the cost function determines the relative phase 
of the search states. This is a generalization of the bit flip 
in Grover's algorithm |1, where the cost function takes 
only the values or 1 (or a constant). The following 
concentration of amplitude on low-cost states, instead, is 
a totally different mechanism than the diffusion operator 
acting in Grover's algorithm. 

Applying again the Hadamard gate H to the first con- 
trol qbit c\ one obtains finally 
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Essentially, the steps H c Uf s Ii c represent the quantum 
equivalent of the classical evaluation of the cost function 
on a search state. Here, the cost function is evaluated on 
all possible search states at the same time. 

This evaluation has now to be repeated b times for all 
control qbits c\ to q,, giving the final result 



N b 



i«^EE cosM &»(^))x 

shi* (|c nor (J*)) $> fc ;J*), (15) 



fc=l i=0 



{j«} 

where { J 4 } denotes the set of all binary numbers of b bits 
with exactly i bits 1 and (6—1) bits 0. Note that the 
overall effect of the b operators H C U^ S H C is an amplitude 
concentration on low-cost search states for such complete 
states which have a large number of control qbits and 
an amplitude concentration on high-cost search states if 
there are many control qbits with value 1. This is the core 
of the deterministic part of the quantum optimization 
procedure, which is concluded here. 

At this point one proceeds to a measurement of the 
control register. Given that the amplitude is most con- 
centrated on low-cost states when all control qbits are in 
state |0) one retains the resulting projected state only if 
the control register is measured in state |0i, . . . , 0&). In 
general this entails some repetitions of the determinis- 
tic transformation described above and of the meausre- 
ment until this state is obtained. The expected number 
of these repetitions is l/P®, where P b ° is the probability 
that |ci,. ..,£%} = |0i,.. .,0j,): 
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Once established that the control register is in the desired 
state one can proceed to a measurement of the search 
state \S). This measurement will yield state \I ) with a 
probability 
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which is peaked on the low-cost states, exactly as desired 
for an optimization heuristic. Overall, the quantum op- 
timization procedure consists thus of a series of indepen- 
dent trials, each of which returns a set of values for the 
control qbits. As soon as one obtains the desired val- 
ues for these control qbits one can proceed to measure 
the search state, with a high probability of selecting a 
low-cost state. 

Completing the specification of the algorithm requires 
selecting a value for the number b of control qbits. Unfor- 
tunately, there is no general rule to select the best value of 
b, since this depends on the problem at hand. It is impor- 
tant, however, to point out that there is a generic trade- 
off between the advantages and disadvantages of high 



and low values of b. Selecting a high value of b clearly 
enhances the probability of finding the true minimum- 
cost state, since the probability distribution P b becomes 
more and more peaked towards the low-cost states: 
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where fc m ; n is the index of the minimum-cost state (as- 
sumed for simplicity to be unique). On the other hand, 
however, high values of b make the probability P b ° of mea- 
suring all control qbits in state |0) lower, increasing thus 
the expected number of repetitions of the deterministic 
part of the algorithm before one obtains the desired val- 
ues of the control qbits permitting to proceed. 

For the purpose of comparing with classical algorithms, 
a measure of the computational load of a combinatorial 
search heuristic can be taken as the number of times the 
cost function has to be evaluated. For classical algo- 
rithms this scales usually as n or a small power of n, 
in order to obtain good-quality results. Quantum paral- 
lelism, instead, allows one to evaluate the cost function 
on all instances at the same time. The price to pay is 
the expected number 1/P b of repetitions of this overall 
evaluation in order to obtain the correct state for a mea- 
surement. These repetitions are however harmless, since 
their number is independent of n for large n. This follows 
from the fact that the probability P b in (jlj) has a finite, 
non-vanishing large-n limit, given that < C nor (^ fe ) < 1 
for all I k . 

As a consequence, the computational load of quantum 
optimization is determined entirely by the parameter b. 
The role of this parameter can be better understood by 
examining closer eqs. (|l7|) and (|l8|). The quantum dis- 
tribution described by these equations is equivalent to 
a canonical Boltzmann distribution with (dimensionless) 
effective temperature t = l/b and (dimensionless) energy 
levels given by 



E k = -2 log cos (|<7 nor (I k ) 
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with Z in eq. (18) playing the role of the partition func- 
tion. The relation between the unbounded, positive en- 
ergies E entering the effective thermal distribution and 
the bounded, normalized cost function simplifies in the 
two limits of low and high cost: 



E ~ log 
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As expected, the deviation is largest for high-cost config- 
urations: the logarithmic transformation maps the region 
near the bound 1 of C nor to the positive axis for E. 

The appearance of an effective thermal distribution 
highlights the analogy between this quantum optimiza- 
tion procedure and simulated annealing. In this classi- 
cal search heuristic one approaches a low-cost state by 



lowering the temperature in a simulated thermal ensem- 
ble generated by an appropriate number of Monte-Carlo 
steps. In the quantum optimization algorithm proposed 
here one obtains a low-cost configuration by choosing the 
effective temperature t — 1/6 low enough. This can be 
tuned by adding an appropriate number of control qbits. 
As in classical simulated annealing, one can use the ef- 
fective thermal ensemble to derive the average behaviour 
of the optimization. As first pointed out in ^ , this is a 
better measure of the heuristic performance than a worst- 
case analysis when the size of the problem becomes large. 
Following the classical approach |15| I shall thus concen- 
trate on the free energy F defined by 
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where I have chosen a normalization such e~ bF ( b ' de- 
scribes the deviation of the partition function from its 
value for 6 = 0. Since Z/2 n possesses a finite, non- 
vanishing large-n limit, as explained above, this normal- 
ization ensures that F(b) is intensive, exactly like the 
energy levels (E5), and scales as a constant for large n. 

The free energy describes the equilibrium of the sys- 
tem at effective temperature t — 1/6 and has the usual 
expression in terms of the internal energy U and the en- 
tropy S, 

F(t)= U(t) - tS(t) , 
U(t)= (E) t , 
-dF(t) 



S(t)= 



dt 



(23) 



By inverting equation (|2C|) one can then also define an 
effective cost function C{t) at temperature t: 



2 F(t) 

C n or(t)— — arccos e 2 

7T 
C(l) = C m i n + (C m 



C'minJ Crior^J • 



(24) 



This corresponds exactly to representing the probability 
©as 



C(oo)-C(0) 
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By construction this is independent of n to leading or- 
der. Any level of accuracy can thus be reached by tuning 
the effective temperature t to values low enough, inde- 
pendently of n. The computational load is determined 
by 6 = 1/i and is thus also independent of n. In other 
words one can define a proper thermodynamics by taking 
the limit n — > oo in equations (|17j) and ( |l8| ) . In this limit 
one is left with the parameter t alone: this determines 
both the accuracy via ( [27| ) and the computational load 
via 6 = 1/t. 

The quantum optimization algorithm described here 
represents a huge improvement upon the exact quantum 
search for the minimum [Q , which has a computational 
load of vN, with N = 2™. The price to pay is the ap- 
proximate character of the solution. It is this approxi- 
mation which allows the improvement without violating 
known bounds for exact quantum results pq| . My quan- 
tum optimization procedure is also much faster than clas- 
sical search heuristics, which typically involve computa- 
tion times growing like small powers of \og(N). The rea- 
son here lies in quantum parallelism. This is seen most 
explicitly by comparing with classical simulated anneal- 
ing: in this algorithm a thermal distribution has to be 
simulated by computation at each temperature. This in- 
volves long relaxation times which constitute already one 
source of the log(A) computational load. Due to quan- 
tum parallelism, instead, the whole thermal distribution 
is generated in one go. 

Let me conclude by mentioning a particularly interest- 
ing case. This arises when the effective thermal distribu- 
tion undergoes a (first order) phase transition at t = i cr . 
In this case one has C(t) = C(oo) for t > i cr , while 
for t < t CY the system is frozen into a "quantum solid 
state" with C(t) rapidly approaching its limiting value 
C(0). An example of this phenomenon in the framework 
of quantum pattern recognition will appear in a forth- 
coming publication. 



P° = cos 2b (| C nor (6)) , 
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which can be taken as the primary definition of the ef- 
fective cost function C. 

At t = oo all configurations I k contribute equally to 
the partition function and thus C(t = oo) is a non- linear 
function of the average cost computed from equation (0). 
At t = only the optimal configuration survives in the 
partition function and C(t = 0) is thus exactly the mini- 
mum cost, C(t = 0) = Copt- In general one can write 



C(t) = C(oo) - A(t) , 



(26) 



with A(t) representing the average gain due to the op- 
timization at effective temperature t. A measure of the 
accuracy of the optimization is then given by 
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